The phrase "to wash the windows" means to clean the glass on windows using water, soap, and a cloth or squeegee.